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ABSTRACT 


We  study  the  dual  problem  corresponding  to  a  linear  program  in  which 
the  stochastic  objective  function  is  replaced  by  its  expected  utility,  and 
discuss  its  relevance  as  a  penalty  method  to  a  stochastically  constrained 
dual  linear  program. 


KEY  WORDS 

Stochastic  Linear  Programming 
Expected  Utility 
Penalty  Methods 


1 .  INTRODUCTION 


Consider  a  linear  programming  problem  with  a  stochastic  objective  function: 

(SO-P)  supt'c^x  :  Ax  <  b  ,  x  >  0} 

where  x  G  Rn  is  the  decision  vector,  A  is  a  given  fixed  matrix  of  size  m  x  n  , 

.  rn 

b  is  a  given  fixed  vector  in  R  ,  and  c  is  a  random  vector  with  a  known  distribu- 

.  n 

tion  function  F  (•)  ,  and  mean  E (c )  =  u  £  R 
c 

A  fundamental  decision-theoretic  approach  to  solve  problem  (SO-P)  is  the  well 
known  expected  utility  principle  (see  for  example  (9],  [5])which  reduces  problem  (SO-P) 
to  the  deterministic  nonlinear  programming  problem: 

(EU-P)  SuptEuCcSc)  :  Ax  <  b  ,  x  >  0} 

where  E  denotes  the  mathematical  expectation  with  respect  to  the  random  vector  c  , 
and  u  is  the  decision  maker  utility  function,  which  is  strictly  increasing  and  con¬ 
cave.  .  The  latter  property  reflects  a  risk-aversion  attitude.  (See  e.g.  the  papers 
of  Arrow  (1]  and  Pratt  [6]).  Under  these  conditions  problem  (EU-P)  becomes  a  concave 
nonlinear  programming  problem. 

The  purpose  of  this  paper  is  to  investigate  the  dual  problem  of  (EU-P)  and  to 
discuss  its  relations  to  the  dual  linear  program  of  (SO-P) : 

*-  -h 

(SC-D)  min{b'"y  :Ay>Ciy>0}. 

which  is  a  linear  program  with  stochastic  constraints.  In  fact  we  find  it  appropriate 
to  deal,  instead  of  problem  (EU-P),  with  an  equivalent  problem 

(CE-P)  sup{u  ^EutcSc)  :  Ax  <  b  ,  x  >  0} 
where  u  1  js  the  inverse  of  u  .  Note  that  for  a  random  variable  T 


is  the  so-culled  certainty  equivalent,  of  T:  ;t  is  the  sure  amount  which  leaves  the 
decision  maker  indifferent  to  a  gamble  yielding  T,  since 


u(C(T)  =  Eu (T) . 

There  are  few  reasons  to  prefer  the  formulation  (CE-P)  to  (EU-P) : 

(i)  In  the  deterministic  case  (c  being  a  degenerate  random  vector)  problem  (CE-P) 
reduces  exactly  to  the  original  problem  (SO-P) ,  and  so  the  linear  structure 
of  it  (and  its  dual)  are  recovered. 

(ii)  According  to  the  Von-Neumann-Morgenstern  theory  [8],  the  utility  function 
is  unique  up  to  a  monotone  increasing  affine  transformation.  If  the  (EU-P) 
formulation  is  used,  the  dual  problem  will  depend  on  the  particular  choice 
of  u  .  This  is  not  the  case  with  the  (CE-P)  formulation  since  C(T)  is 
invariant  to  affine  transformation  in  u. 

There  is  however  some  difficulty  associated  with  the  objective  function 
V(x)  =  C(cfcx)  =  u_1Eu(ctx) 

of  (CE-P);  since  u  *  is  convex,  it  is  not  guaranteed  that  V(x)  is  a  concave  func 
tion.  We  show  however,  in  the  next  section,  that  for  a  large  class  of  utility  func¬ 
tions,  including  the  important  class  of  KARA  utilities  (see  [2],  [3],  [5],  [9])  V(x) 
is  concave  regardless  of  the  distribution  of  the  random  vector  c  . 

Properties  of  the  dual  problem  of  (CE-P)  are  derived  in  section  3. 

Section  4  outlines  the  general  approach  to  treat  the  linear  program  with 
stochastic  constraints  (SC-D) .  Approximations  are  given  in  section  5. 

2.  CONCAVITY  OF  THE  CERTAINTY  EQUIVALENCE  FUNCTIONAL 

We  assume  now  and  henceforth  in  this  paper  that 

(i)  The  random  vector  c  =  (c  ,c_,...,c  )  is  non-degenerate,  i.e.  Vx  ^  0 

^  1  2  n 

c  x  is  not  a  degenerate  univariate  random  variable. 

(ii)  E(cfcx)  <  +  »  V  x  £  Rn 


We  denote  by  [c^,c^]  the  support  of  the  random  variable,  by  its  mean  and  by 

a  its  standard  deviation.  Let  U  be  the  class  of  twice  differentiable 
k 

concave  utility  functions  with  u'  >  0  and  u"  ^  0. 

For  a  given  u  €  U  ,  the  inverse  function  u  ^  exists,  and  it  is  a  strictly  mono¬ 
tone  increasing  convex  function.  Thus  problem.  (EU-P)  can  be  transformed  into  an  equi¬ 
valent  one: 


(CE-P)  sup{V(x)  =  u  ^Eu(cTx)  :  Ax  <  b  ,  x  >  0} 


Problem  (CE-P)  is  called  the  certainty  equivalent  problem. 

Note  that  V (x)  is  a  convex  increasing  transformation  (u  )  of  a  concave  function 
EuCcSc),  thus  in  general  V(-)  is  not  necessarily  a  concave  function.  To  be  able  to 
use  the  powerful  duality  theory  of  convex  programming,  it  is  then  of  major  importance 
to  study  conditions  under  which  V(x)  is  concave. 

The  next  result  furnish  a  complete  answer  to  this  question.  Surprisingly,  the 
concavity  of  V(for  arbitrary  distribution  of  the  random  vector  c)  is  fully  charac¬ 
terized  in  term  of  the  so-called  Arrow-Pratt  local  risk  aversion  indicator: 


r(t)  k  -  Hilt) 

u'(t) 


(2.1) 


Theorem  2.1.  Let  u  be  a  utility  function  in  u  .  Then  the  function: 


V (x)  =  u  ^Eu (cTx) 


is  concave  for  any  random  vector  c  if  and  only  if 


(risk  tolerance  indi¬ 


cator)  is  concave. 


Proof:  (The  details  will  appear  elsewhere  in  a  future  paper  and  thus  are  omitted), 

(outline]:  (i)  The  concavity  of  V  is  established  by  showing  that  it  satisfies  the 

gradient  inequality  (see  [7]).  Denoting  by  ,<p(t)  =  u  1(t),  and  using 
the  fact  that  tp '  >  0  ,  the  gradient  inequality  here  is: 


Vx  v  f  Rn  .  <PEu(c  y)  -  <Pfiu(c  x)  <  c  (y-x) _ 

V,<'y£R  •  V'S-icTSi  ip*  (u (cTx,  1 


(2.2) 


(ii)  Given  u  £  U  we  define  h  :  R2  -*■  R  by 


hlr  „  . 

h  tl't2  W  (t2) 


and  show  that  h  is  a  convex  function  if  and  only  if  —  t  —  is 
concave . 

(iii)  Applying  Jensen  inequality  to  h(t  ,t  )  with  t  =  u(cty)  and 
t  12  1 

t  *  u (c  x)  we  get  the  inequality  (2.2), 


Remark  2.1.  The  two  parameter  class  of  utility  functions  called  hyperbolic  absolute 

risk  aversion  (HARA) ,  characterized  by  r(t)  =  *  which  is  widely 

used  in  economics  ([2],  [5],  [9])  satisfies  trivially  the  condition  that 
1 

— -7- r-  is  concave . 
r(t) 

The  HARA  family  consists  of  the  following  utilities  (defined  for  t  >  -  b/a) 


-e-t/b 

if 

a 

log (b+t) 

if 

a 

(at+b) (a"1)/a 

if 

a 

A  utility  function  satisfying  the  condition  that  1/r  (t)  is  concave  will  be  termed 
a  CRT-utility  (concave  risk  tolerance) . 

3.  THE  DUAL  PROBLEM:  AN  INDUCED  u-PENALTY 
The  dual  problem  of 


(CE-P)  sup{V(x)  =  u  ^’Eu(ctx)  :  Ax  <  b  ,  x  >  0} 


is  derived  via  Lagrangian  duality.  We  assume  that  u  is  a  CRT-utility  so  (CE-P)  is 
a  concave  program.  The  Lagrangian  for  problem  (CE-P)  is  the  function  I,:R^  x  r™  -*■  r 
with  values : 


L(x,y)  =  V (x)  + 


yfc (b-Ax) 


(3.1) 


The  dual  objective  function  is  defined  by: 


D(y)  =  sup{V(x)  +  yfc(b-Ax)} 
x>0 

and  thus  the  dual  problem  for  (CE-P)  is  given  by: 


(3.2) 


(CE-D)  inf{ytb  +  sup{V(x)  -  yfcAx}} 
y>0  x>0 

Let 

P  (y)  =  sup{V(x)  -  yfcAx} 

X>0 

Then  problem  (CE-D)  becomes: 


(3.3) 


(3.4) 


(CE-D)  inf  (y  b  +  P  (y)  } 
y>0  U 


(3.5) 


The  first  term,  yfcb  is  just  the  objective  function  of  the  dual  problem  of  (SO-P) 


(SC-D)  inf {bfcy  :  >  c} 

y>0 


(3.6) 


We  show  below  that  the  second  term,  Py  (y)  plays  the  role’ of  a  penalty  function 


for  the  stochastic  constraints  in  (SC-D),  will  be  called  accordingly  u-penalty. 


Theorem  3.1.  The  u-penalty  function  (3.5)  is  convex  and  satisfies: 


(i)  Pu(y)  =  0 


if 


„t 

A  y  >  y 
Aty  j  ji 


(3.7) 


(ii)  P  (y)  >  0 


if 


(3.0) 


As  a  pointwise  supremum  of  affine  functions, 


P  (y) 
u 


is  convex. 


(i)  Let 


Q(y ;x)  =  V (x)  -  yfcAx 


then 


P  (y)  =  sup  Q(y;x)  >  Q(y;0)  =  0  (3.9) 

U  x>0 

since  u  £  U  ,  by  Jensen  inequality  v(x)  =  u  1Eu(ctx)  <  pfcx 
equality  holds  only  for  x  =  0  ,  and  so 

P  (y)  =  sup  Q (y ;x)  <  sup  xt(p-Aty)  (3.10) 

x>0 


Now  if  A^y  >  p  ,  the  inequality  (3.10)  shows  that  P^(y)  <  0 
together  with  (3.9)  proves  (3.7). 


(ii)  Assume  that  for  some  k (k=l, . . . ,n) ,  A*  y  <  p 

^  A 

where  A  is  the  k-th  row  of  A. 
k 

Let  ^k ^?Xk^  =  2 (y ?  0 , 0 , . . .  ,Xj^, . . . 0)  =  V(x^)  —  x^A  ky 

d  T 

Then  we  have  Q^(y;0)  =  0  and  Q^ty.-O)  =  p^  -  A^y  >  0  . 

„  k 

Hence  there  exists  x,  >  0  such  that: 

k 

a 

V^'V  >  Vy;0>  =  0  (3*11) 


Noting  that 


P  (y) 

u 


> 


sup  Qk(y;xk) 

Rn3x,  >o 
k~ 


(3.12) 


,  v/here 


which 


and  using  (3.11),  it  follows  that  P  (y)  >  0. 
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The  theorem  demonstrates  that  P^(y)  penalizes  solutions  of  (SC-D)  which  are  not 
feasible  in  the  mean. 

We  say  that  is  less  feasible  than  y.^  for  the  k-th  constraint  (in  the  mean) 


.t  S 

\  y2  >  \  yi 


(3.13) 


and  we  write 


it  yi  >•  y2  • 


The  next  result  shows  other  desirable  properties  of  the  u-penalty.  For  the  k-th 
constraint  we  define: 


P.k  (y)  -  sup{V(xk)  -  XjA^y} 


Theorem  3.2  The  u-penalty  function  satisfies 


(i)  if  y1  >  y2  then  P*  (y1)  >  P*  (y2) 


(ii)  if  for  soma  k:  y  <  c_k  then  P^(y)  =  °° 


(3.14) 


(3.15) 


(3.16) 


Proof : 


(i)  For  y^  >  y2  we  have  by  (3.13): 

V(V  ‘  yk  ’  vlV  -  Vk  y2 

and  then  using  (3.14)  the  inequality  (3.15)  holds. 
T 

(ii)  Let  \  y  <  cjc  *  ®y  (3.12)  we  have: 

Pu(y)  >  sup{V(xk)  -  x^y) 


since  u  is  increasing  and  c  >  c  ,  (3,17)  implies: 

Pu(y)  >  sup{u  Wcj*  >  -  xkA^y)  =  sup{  (c  -  Aky)xk} 
xk>9  xk>0 


(3.17) 


(3.18) 


and  hence  (3.16)  follows. 


Theorem  3.2  demonstrates  that  the  u-penalty  is  monotone  in  the  sense  defined 
in  (3.13) 

The  second  property  (3.16)  shows  that  the  u-penalty  automatically  excludes 
solutions  which  are  not  feasible  for  (SC-D)  in  probability  1,  since  for  those 

p  (y)  -  00  • 

4 .  LINEAR  PROGRAMMING  WITH  STOCHASTIC  CONSTRAINTS:  A  GENERAL  APPROACH 

In  this  section  we  use  the  properties  of  the  u-penalty  studied  previously  i  out¬ 

line  a  general  approach  for  linear  programming  problem  with  stochastic  constra  r-=> : 

-  t. 
mi  y  b 

(SC)  A^y  >  c  k  =  l,...,n 

y  >  0 


Suppose  that  the  decision-maker  accepts  a  solution  y  as  being  "feasible"  for  th 


t  t 

constraint  Ay  >  c  if  A  y  is  "large  enough",  and  rejects  solutions  y  for  which 
Ay  is  "too  small",  i.e.  he  can  choose  two  positive  numbers  k^,  k2  such  that: 


t  (*) 

y  is  feasible  if  A^y  >  +  k^a^ 


y  is  infeasible  if  A^  <  -  k^ 


all  other  solutions  ,  i.e.  y's  such  that: 


\  '  h0 :  V  *  "r  +  kA 


are  "semi-feasible", 


(*)  If  "Feasibility"  is  modeled  by  chance  constraint  [4J ,  i.e.  Pr (A*y  >  c  )  >  a  , 

k  “•  k  -  k 

1,1 .  ",  (a.  )  where  F  is  the  distribution  function  of  the  random  variab 

zk  k  zk 

,  and  a  6  [0,1]  are  prescribed  probabilities  levels. 


Zk  = 


Ck-\ 
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We  will  new  .build  a  penalty  function  P^(y)  for  bhe  k-th  constraint  of  (SC) 
will  reflect  the  above  subjective  attitude  for  the  decision-maker. 

Let  u  be  a  CRT-utility.  For  fixed  k  define: 


a.  =  (k,+k„)  •  - 

k  1  2  yk-cR 


(4.1) 


\ =  vk  -  (kiVk2V  *  r^r 

k  -k 


(4.2) 


and  let  c*  be  the  random  variable: 

k 


Ck  =  Vk  +  8k 


The  penalty  function  is  given  by; 


Pk(y)  =  sup  {u-1Eu(c*jx,  )  -  x ,  A.fcy} 

u  x  >0  k  k  k  k 

k- 


(4.3) 


The  coefficients  a,  were  chosen  so  that: 

k  k 


E<cj)  =  v,k  +  klok 


c-t  '"k-Vk- 


hence  by  Theorem  3.1  and  Theorem  3.2  (ii)  we  have: 


Pj>)  ~ 


positive 


if  V  >  ^  *  klck 
if  A,V  <  U,  -  k„o, 

k*  k  2  k 
otherwise 


(4.4) 

(4.5) 

(4.6) 


Thus  semi-feasible  solutions  cause  a  positive,  but  finite  penalty.  Moreover, 
Theorem  3.2  (i) ,  the  more  they  violate  feasibility,  the  more  they  are  penalized. 


which 


by 

Thus, 


the  approach  we  advocate  for  treating  the  stochastic  linear  program  (SC)  is  to  use  the 
surrogate  deterministic  program  (P) : 

(P)  infiy^  +  l  Pk(y)}  (4.7) 

y>0  k=l  U 

In  comparison  with  problem  (CE-D)  in  (3.5),  we  use  here  an  additive  penalty 
(sum  of  penalties  for  individual  constraints)  rather  than  a  joint  constraints  penalty. 
The  additive  form  is  clearly  advantageous  from  the  computational  viewpoint.  It  is 
applicable  whenever  the  decision  maker  can  treat  the  constraints  individually.  However 
there  is  one  choice  of  the  utility  function  under  which  the  joint  constraints  penalty 
is  additive: 

Theorem  4.1.  Let  u  be  an  exponential  utility  function: 

u  (t)  =  a  -  be~t//p  (p>0  ,  b>0  ,  a£R) 

If  the  random  variables  c  ,  c_,...,  c  are  independents  then: 

y  J-  n 

n  k 

P  (y)  =  z  P  (y) 
k=l  u 

k  -c x 

where  here:  Pu<y)  =  P  '  sup{-log  E(e  K)  -  x  Ay} 

U  x,  >0  k  * 

k- 

Proof :  The  result  follows  immediately  from  the  fact  that  in  the  case  of  exponential 

utility  the  certainty  equivalent,  in  terms  of  which  Py  is  defined,  is  additiv 
(See,  {2J ,  Theorem  4) .  a 

We  close  this  section  by  a  simple  illustrative  example.  Consider  the  one  dimen¬ 
sional  inventory  problem: 

(SC)  min{hy  :  y  >  d  ,  y  >  0} 
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« 


where  h  is  the  unit  holding  cost  and  d  is  the  demand.  Assume  that  d  'v  exp(X)  with 

mean  y  =  -  and  o  =  ~  (X  >  0)  .  Let  u(t)  «  1  *•  e"t/p(p>0);  i.e.  the  risk-aversion 

indicator  is  r(t)  =  —  .  Then  by  (4.3)  the  penalty  function  is: 

P 


pu  (y) 


sup{-p  log 
x>0 


X 

X+x 


where  here,  by  (4.1)  -  (4.2)  :  o  =  »  3  -  y(l~k0). 

By  simple  calculus  we  obtain: 

l>0  if  y  >  (l+k^ )  y 

k  +  k  y-y(k  +1) 

P  (y)  =  <  p{log  y  —nrZvT  +  TTTk .  +~k~T  }  if  ^  (1"k  )<y<y(l+k  ) 


y+y(k2-l)  y(kx  +  k2) 


if  y  <  y(l-k2> 


Note  that  p  plays  here  the  role  of  a  penalty-parameter.  Subsittuting  in  (4.7) 
and  solving  problem  (P)  we  obtain 


k.  +  k 

y*  =  y  (1-k  )  +  u  - - - ”t™ 

1  +  MCVk2}F 


The  optimal  inventory  y*  is  a  monotone  decreasing  function  of  both  the  holding 
cost  h  and  the  risk-aversion  1/p.  If  either  h  =  0  or  1/p  •*■  0  (risk  neutrality) 
then  y*  equals  to  the  highest  value  y(l+kp  while  if  h  -*■  »  or  1/p  00  (extreme 

risk  aversion)  y*  equals  to  lowest  value  y(l-k2). 


5.  MEAN  VARIANCE  APPROXIMATIONS 

In  this  section  we  derive  a  quadratic  approximation  for  the  u-penalty  function 

p  (y). 

u 

Denote  the  mean  vector  of  c  by  y  ,  and  by  V  its  variance-covariance  matrix 
(positive  definite) . 


12 


It  can  be  shown  by  direct  differentiation  of  the  certainty  equivalent  functional 


V(x).  =  u"1Eii(ctx) 


that: 


V(0)  =-•  0 


W(0)  =  n 


V2V(0)=  -r  V  with 


A  u" (0) 

r  =  - - >  0 

o  u'(0)  - 


Using  this  in  (3.4)  we  obtain: 


Proposition  5.1.  A  second  order  approximation  of  P^ty)  is: 


P (y)  =  sup{xt(Ay-u)  -  j  r  xlvx} 
x>0 


(5.1) 


Thus  the  approximate  u-penalty  Pfj(y)  is  given  in  term  of  a  concave  quadratic  program.  A 


direct  compution  shows  that  the  approximation  is  exact  for  the  case  of  exponential  util¬ 
ity  and  c  being  jointly  normal. 

For  additive  penalties,  even  a  more  explicit  approximation  is  possible: 


Proposition  5.2.  A  second  order  approximation  P  (y)  of  P  (y)  =  IP  (y)  is: 

k=l 


O  K-  1 


(5.2) 


where  a  =  max(0,a) 


Proof:  We  have  to.  show  that: 


pV) - i—  |(M  .  A*y)  ] 

2ro<I2  k  k  + 


(5.3) 


Now  from  Proposition  5.1  we  have  for  the  k-th  constraint: 


Pk<y)  -  sup  IW^y,  -  Vfc  *V 


x,  >0 
k- 


which  by  simple  calculus  gives  (5.3) . 


□ 
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